FaST-Net: Face Style Self-Transfer Network for Masked Face Inpainting

During the COVID-19 coronavirus epidemic, people usually wear masks to prevent the spread of the virus, which has become a major obstacle when we use face-based computer vision techniques such as face recognition and face detection. So masked face inpainting technique is desired. Actually, the distribution of face features is strongly correlated with each other, but existing inpainting methods typically ignore the relationship between face feature distributions. To address this issue, in this paper, we first show that the face image inpainting task can be seen as a distribution alignment between face features in damaged and valid regions, and style transfer is a distribution alignment process. Based on this theory, we propose a novel face inpainting model considering the probability distribution between face features, namely Face Style Self-Transfer Network (FaST-Net). Through the proposed style self-transfer mechanism, FaST-Net can align the style distribution of features in the inpainting region with the style distribution of features in the valid region of a face. Ablation studies have validated the effectiveness of FaST-Net, and experimental results on two popular human face datasets (CelebA and VGGFace) exhibit its superior performance compared with existing state-of-the-art methods. © 2023 SPIE.

An approach for Face Detection and Face Recognition using OpenCV and Face Recognition Libraries in Python

With the extraordinary growth in images and video data sets, there is a mind-boggling want for programmed understanding and evaluation of data with the assistance of smart frameworks, since physically it is a long way off. Individuals, unlike robots, have a limited capacity to distinguish unexpected expressions. As a result, the programmed face proximity frame- work is important in face identification, appearance recognition, head-present evaluation, human-PC cooperation, and other applications. Software that uses facial recognition for face detection and identification is regarded as biometric. This study converts the mathematical aspects of a person's face into a face print, which is then stored in a database to verify an individual's identification. A deep learning system compares a digital image or an image taken quickly to a previously stored image(which is saved in the database). The face has a significant function in interpersonal communication for identifying oneself. Face recognition technology determines the size and placement of a human face in a digital picture. Facial recognition software has a wide range of uses in the consumer market and in the security and surveillance sectors. The COVID pandemic has brought facial recognition into greater focus lately than ever before. Face detection and recognition play a vital part in security systems that people need to interact with without making physical contact. The pattern of online exam proctoring is employing face detection and recognition. Facial recognition is used in the airline sector to enable rapid, accurate identification and verification at every stage of the passenger trip. In this research, we focused on image quality because it is the major drawback in existing algorithms and used OPEN CV, Face Recognition, and designed algorithms using libraries in python. This study discusses a method for facial recognition along with its implementation and applications. © 2023 IEEE.

CNN Model for Analyzing Masked Facial RGB Images Using Cloud Computing

The world invasion of dangerous virus diseases such as Covid 19, in the last few years, force people to wear masks as precaution. Although this prudence reduces the risk of infection and viruses' spread, it adds difficulty to distinguishing or identifying a person. This paper proposes a method to analyze images of masked persons for classifying their gender, in addition to identifying the colors of their skin and their eyes. We apply residual learning using the convolutional neural network (CNN) based on the visible part of the face. Cloud computing resources have been used as a convenient environment of substantial computing ability. Also, new database of RGB face images was created for testing. Experiments have been operated on the constructed database beside other datasets of facial images after cropping. The proposed model gives 96% gender classification accuracy and 100% skin/eye color identification. © 2023, Ismail Saritas. All rights reserved.

Automated Contactless Continuous Temperature Monitoring System for Pandemic Disease Controlling Infrastructures

People are being thermally screened in hospitals and in such facilities, all the data collected must be stored and displayed. The person responsible for keeping track of people's body temperatures must put in more time and effort. This approach is a tedious task, especially during times of dealing with the pandemic diseases like Covid-19. Hence, in this paper, an automated contactless continuous temperature monitoring system is designed to eliminate this time-consuming process. If a person's temperature is too high, that is, higher than the usual temperature range, the system records it and monitors it continuously via a mobile application. In this paper, we present the development of an Automated contactless continuous body temperature monitoring system using a Raspberry Pi camera and mobile application. © 2023 IEEE.

Facemask detection using Deep Learning

COVID-19 was raised in the year 2020 which became more dangerous to society. According to the medical results, 100 million confirmed cases and 6 million deaths. This virus became an obstacle to gathering people in public places. This virus has spread all over the world. So, the Government has implemented a facemask policy to prevent the hazardous virus. It is a very difficult task to observe manually in crowded places. Most people are not wearing facemasks properly in public a place which causes the increase of the virus. So, the proposed model will detect the face mask whether the people are wearing it or not. By using, the HAAR-CASCADE technique we can able to detect whether the people are wearing the mask or not. By using this algorithm, we can able to prevent affecting of the virus to the person. This algorithm works effectively for detecting facemasks. The system compares faces with masks and faces without the mask. If people are not wearing a mask, the system detects through the camera and alerts by the alarm sound. The experiment results show the proposed technique achieves a 95% accuracy rate. © 2023 IEEE.

Baseline Estimation in Face Detection for AI Proctored Examinations through Convoluted Neural Networks

The COVID-19 pandemic took the world by surprise, and everything came to a halt. The education sector had to adjust accordingly by shifting to online learning. If the online delivery experience was overall successful, assessment integrity becomes questionable as examinees still manage to circumvent the anti-plagiarism mechanism put in place. In this paper, we propose an artificial intelligence solution using face and head pose detection to estimate the neutral position of the examinee which will form the basis to detect any suspicious behavior. The resulting implementation achieved a 97% accuracy when detecting the examinee in the frame and a 98% accuracy when there are multiple faces detected. © 2023 IEEE.

Real Time AI Based Face Mask Detector

The present Covid-19 pandemic, face mask detection identifying significant forward movement in the fields of image and computer observation. Several face detection models were developed utilizing various methods and techniques. The dataset arrangement supplied in this work, which was gathered from multiple sources, could be utilized by other to develop more complex representation such as those for facial identification software, facial positions, and facial component identification. The goal of project 'Real Time AI Based Face Mask Detector', It is develop a tool that really can identify a person image and to affect whether he or she is wearing a mask. COVID makes it necessary to wear a face mask to keep it safe. As the country begins to reopen in stages, face masks have become a crucial part of our everyday life to keep safe. Face masks will be essential for socializing and conducting business. As a result, this software uses a camera to notice whether a person is wearing a mask or not. © 2022 IEEE.

A Novel Real-time Automated Face Classification and Detection system using Machine Learning Technique

In recent days, Image classification and detection technique has become an important and more essential in the Image processing research field. Creating effective face detection is an essential aspect of handling the detection mechanism, Tracking mechanism and Validation mechanism. The classical methods used for face detection do not have sufficient output. This research paper presents various studies and how machine learning methods are become to solve many challenges present in the face detection system. The first phase of work has a classification model with support vector machines, decision trees and Hybrid Ensemble Transfer learning algorithm. The second phase of work is investigated with real-the world's most popular dataset from World Masked Face Image Dataset and Label Faces in the wild (RMFD). Moreover, the experiment, results show how better accuracy and fast computation which has been achieved by Hybrid Ensemble algorithm with SVM and Decision Trees machine learning techniques. This research helps to assist many social applications such as during pandemics like covid-19 and personal identity, it can be verifying the mask-worn persons. © 2023 IEEE.

COVID-19 Face Mask Classification Using Deep Learning

The COVID-19 pandemic has triggered a global health disaster because its virus is spread mainly through minute respiratory droplets from coughing, sneezing, or prolonged close contact between individuals. Consequently, World Health Organization (WHO) urged wearing face masks in public places such as schools, train stations, hospitals, etc., as a precaution against COVID-19. However, it takes work to monitor people in these places manually. Therefore, an automated facial mask detection system is essential for such enforcement. Nevertheless, face detection systems confront issues, such as the use of accessories that obscure the face region, for example, face masks. Even existing detection systems that depend on facial features struggle to obtain good accuracy. Recent advancements in object detection, based on deep learning (DL) models, have shown good performance in identifying objects in images. This work proposed a DL-based approach to develop a face mask detector model to categorize masked and unmasked faces in images and real-time streaming video. The model is trained and evaluated on two different datasets, which are synthetic and real masked face datasets. Experiments on these two datasets showed that the performance accuracy rate of this model is 99% and 89%, respectively. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Face Mask Detection Using Multi-Task Cascaded Convolutional Neural Networks

Detecting faces is a prevalent and substantial technology in current ages. It became interesting with the use of diverse masks and facial variations. The proposed method concentrates on detecting the facial regions in the digital images from real world which contains noisy, occluded faces and finally classification of images. Multi-task cascaded convolutional neural network (MTCNN)—a hybrid model with deep learning and machine learning to facial region detection is proposed. MTCNN has been applied on face detection dataset with mask and without mask images to perform real-time face detection and to build a face mask detector with OpenCV, convolutional neural networks, TensorFlow and Keras. The proposed system can be used as an application in the recent COVID-19 pandemic situations for detecting a person wears mask or not in controlling the spread of COVID-19. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Face Mask Detection Using MobileNetV2 and VGG16

As the COVID-19 situation is not over yet, a new strain of corona virus is again affecting population. Strain like Omicron and Deltacron still poses thread to the society. It is very necessary to keep our self-safe. To prevent spread of COVID few precautions are suggested by governments in the world like maintaining distance of 1 m, use of hand sanitizer, and always wear a mask. The new variant of COVID is now reported by the WHO on November 28, 2021;it was first designated as B.1.1.529 and then named as omicron and later a hybrid variant of delta and omicron was also reported. As these are affecting large population and seeing continuous straggle, it can conclude that corona virus can affect people for few more years considering the current scenario. Keeping that in mind people made face detection software which can be used to tell that a person wearing a mask not. This project is based on same object by using two different technologies MobileNetV2 and VGG16 so that a detail comparing can be done. By comparing both of them it can be known that which perform better and people can choose according to their necessity. This research paper is based on machine learning algorithm and deep learning using different Python libraries like OpenCV, TensorFlow with Keras, MobileNetV2, and VGG16. In this project, the main aim this to detect and then identify that person is wearing a mask or not then comparing both technologies and analyzes the result. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Drowsiness Detection System for Masked Face Based on Deep Neural Network and Haar Cascade

Nowadays, technology is growing rapidly followed by modernization. Face detection technology is one technology that has been developed and applied in various sectors such as biometrics recognition systems, retrieval systems, database indexing in digital video, security systems with restricted area access control, video conferencing, and human interaction systems. Eye detection is a further development of face detection in which the image of a human face was detected to be processed by detecting the location of both eyes on the face. Nowadays, the eye detection system can be used as a means of developing more complex applications and can be applied directly in the aspect of technology that uses eye detection like, eye state detection system, drowsiness and fatigue detection system, safety driving support systems or driver assistance system. In this study we propose drowsiness detection system utilizing current novel classification model such as Deep Neural Network (DNN), combined with Haar Cascade. The DNN is utilized to detect face, while Haar Cascade is utilized for detecting the eyes and its state on the detected face. In this study, due to Covid19 pandemic, we focused on developing the classifiers for detecting the face with mask. Apart from that, our proposed classifiers are also capable of identifying non-masked faces. The experimental result showed that by utilizing DNN and Haar Cascade, our proposed system could reach accuracy, precision, recall, and f1 measure as much as 81%, 88%, 80%, and 84%, respectively. © 2022 IEEE.

An Efficient Automatic Face Mask Detection System for Human Safety Based on Deep Learning using Novel YOLOv3 in Comparison of YOLO with Improved Accuracy

The objective is to build an efficient face mask detector using Novel YOLOv3. The algorithm used to detect face masks is Novel YOLOv3 in comparison with YOLO, the dataset used was (Facemask Detection Dataset, no date) with the sample size was 136. Novel YOLOv3 gets an accuracy of 92% and in YOLO it is 88% the increase in accuracy is due to the use of Darknet53 neural network model, the novel YOLOv3 and YOLO are statistically satisfied with the independent sample t-test value (\mathrm{P}\unicode{x00A1}{0.001}) with confidence level of 95%. Face Mask detection in Novel Yolov3 has a significantly better accuracy than YOLO. © 2022 IEEE.

Empirical Study of U-Net Based Models for 2D Face Recovery from Face-Mask Occlusions

Human face related digital technologies have been widely applied in various fields including face recognition based biometrics, facial landmarks based face deformation for gaming, facial reconstruction for those who are disfigured from an accident in the medical field and others. Such technologies typically rely on the information of a full, uncovered face and their performance would suffer varying degrees of deterioration according to the level of facial occlusion exhibited. 2D face recovery from occluded faces has therefore become an important research area as it is both crucial and desirable to attain full facial information before it is used in downstream tasks. In this paper, we address the problem of 2D face recovery from facial-mask occlusions, a pertinent issue that is widely observed in situations such as the Covid-19 pandemic. In recent trends, most researches are carried out through deep learning techniques to recover masked faces. The whole process consists of two tasks which are image segmentation and image inpainting. As U-Net is a typical deep learning model for image segmentation, but it also helpful in image inpainting and image colorization, so it has been frequently used in solving face recovery problems. To further explore the capability of U-Net and its variants for face recovery from masked faces, we propose to conduct a comparative study on several U-Net based models on a synthetic dataset that was generated based on public face datasets and mask generator. Results showed that Resnet U-Net and VGG16 U-Net had performed better in face recovery among the six different U-Net based models. © 2022 IEEE.

Face Mask Detection Using MobileNetV2 and VGG16

As the COVID-19 situation is not over yet, a new strain of corona virus is again affecting population. Strain like Omicron and Deltacron still poses thread to the society. It is very necessary to keep our self-safe. To prevent spread of COVID few precautions are suggested by governments in the world like maintaining distance of 1 m, use of hand sanitizer, and always wear a mask. The new variant of COVID is now reported by the WHO on November 28, 2021;it was first designated as B.1.1.529 and then named as omicron and later a hybrid variant of delta and omicron was also reported. As these are affecting large population and seeing continuous straggle, it can conclude that corona virus can affect people for few more years considering the current scenario. Keeping that in mind people made face detection software which can be used to tell that a person wearing a mask not. This project is based on same object by using two different technologies MobileNetV2 and VGG16 so that a detail comparing can be done. By comparing both of them it can be known that which perform better and people can choose according to their necessity. This research paper is based on machine learning algorithm and deep learning using different Python libraries like OpenCV, TensorFlow with Keras, MobileNetV2, and VGG16. In this project, the main aim this to detect and then identify that person is wearing a mask or not then comparing both technologies and analyzes the result. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

JDSR-GAN: Constructing An Efficient Joint Learning Network for Masked Face Super-Resolution

With the growing importance of preventing the COVID-19 virus in cyber-manufacturing security, face images obtained in most video surveillance scenarios are usually low resolution together with mask occlusion. However, most of the previous face super-resolution solutions can not efficiently handle both tasks in one model. In this work, we consider both tasks simultaneously and construct an efficient joint learning network, called JDSR-GAN, for masked face super-resolution tasks. Given a low-quality face image with mask as input, the role of the generator composed of a denoising module and super-resolution module is to acquire a high-quality high-resolution face image. The discriminator utilizes some carefully designed loss functions to ensure the quality of the recovered face images. Moreover, we incorporate the identity information and attention mechanism into our network for feasible correlated feature expression and informative feature learning. By jointly performing denoising and face super-resolution, the two tasks can complement each other and attain promising performance. Extensive qualitative and quantitative results show the superiority of our proposed JDSR-GAN over some competitive methods. IEEE

Toward High-quality Face-Mask Occluded Restoration

Face-mask occluded restoration aims at restoring the masked region of a human face, which has attracted increasing attention in the context of the COVID-19 pandemic. One major challenge of this task is the large visual variance of masks in the real world. To solve it we first construct a large-scale Face-mask Occluded Restoration (FMOR) dataset, which contains 5,500 unmasked images and 5,500 face-mask occluded images with various illuminations, and involves 1,100 subjects of different races, face orientations, and mask types. Moreover, we propose a Face-Mask Occluded Detection and Restoration (FMODR) framework, which can detect face-mask regions with large visual variations and restore them to realistic human faces. In particular, our FMODR contains a self-adaptive contextual attention module specifically designed for this task, which is able to exploit the contextual information and correlations of adjacent pixels for achieving high realism of the restored faces, which are however often neglected in existing contextual attention models. Our framework achieves state-of-the-art results of face restoration on three datasets, including CelebA, AR, and our FMOR datasets. Moreover, experimental results on AR and FMOR datasets demonstrate that our framework can significantly improve masked face recognition and verification performance. © 2023 Association for Computing Machinery.

Synthetic ID Card Image Generation for Improving Presentation Attack Detection

Currently, it is ever more common to access online services for activities which formerly required physical attendance. From banking operations to visa applications, a significant number of processes have been digitised, especially since the advent of the COVID-19 pandemic, requiring remote biometric authentication of the user. On the downside, some subjects intend to interfere with the normal operation of remote systems for personal profit by using fake identity documents, such as passports and ID cards. Deep learning solutions to detect such frauds have been presented in the literature. However, due to privacy concerns and the sensitive nature of personal identity documents, developing a dataset with the necessary number of examples for training deep neural networks is challenging. This work explores three methods for synthetically generating ID card images to increase the amount of data while training fraud-detection networks. These methods include computer vision algorithms and Generative Adversarial Networks. Our results indicate that databases can be supplemented with synthetic images without any loss in performance for the print/scan Presentation Attack Instrument Species (PAIS) and a loss in performance of 1% for the screen capture PAIS. Author

A System Design with Deep Learning and IoT to Ensure Education Continuity for Post-COVID

In this paper, an IoT and deep learning-based comprehensive study to reduce the effects of COVID-19 on the education system is presented. The proposed system consists of an edge device, IoT nodes, and a neural network that runs on a server. The purpose of the proposed system is to protect students and staff against infectious diseases and increase the students performance during classes by monitoring the environmental conditions via an IoT-based sensor network, during the current pandemic to ensure the use of masks in closed areas by training a customized deep learning model, and to monitor the student attendance data by deep learning and IoT-based solution. Furthermore, effective heating and cooling can be done to save energy by transmitting the environmental conditions of the indoor environment to the relevant destinations. The experiment is conducted with five different networks to classify the faces in the images as masked or unmasked, and their performances were examined. The networks were trained on the Face Mask Detection Dataset which contains a total of 7553 masked and unmasked images. The best results were obtained as 99.5% for the F1 Score and 99% for MCC by the model trained on the InceptionV3 network. IEEE

Detection of Face Wearing Mask Based on AdaBoost and YCrCb

At the beginning of 2020, COVID-19 broke out and swept the world. Wearing masks remains an important means of preventing epidemics. Many scholars have developed and studied mask wearing detection based on YOLO algorithm, and have made some achievements. AdaBoost algorithm has the advantages of high precision and low complexity, and is also suitable for solving this problem. This paper uses OpenCV to propose a face detection algorithm based on AdaBoost. This algorithm is based on face detection, including initialization of background estimation example, background subtraction preprocessing, obtaining eye position, face detection and other steps. LBP features are used as the training basis of the classifier. The trained classifier is generated and used as a function in the mask detection algorithm. At present, there are two problems in the research of mask wearing detection: first, only consider whether the tested object wears a mask, but not analyze the non-standard wearing of masks;Secondly, due to the influence of light and other external environments, the real-time detection effect of targets in complex scenes changes greatly. In view of the above problems, this paper adopts the following methods to solve them: pre-processing the image to reduce noise, light spots and other external environmental interference;For the case that the mask is not standardized, the condition that the mask covers the nose and mouth shall be detected. Finally, the Adaboost algorithm for facial mask wearing detection is obtained. Experiments show that the algorithm has high adaptability, robustness and accuracy, and can be used to promote the development of epidemic prevention. © 2022 IEEE.